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Abstract 

Neutrinoless 3-prong tau lepton decays into a charged lepton and either two 
charged particles or one neutral meson have been searched for using 4.79 fb^^ 
of data collected with the CLEO II detector at CESR. This analysis represents 
an update of a previous study and the addition of six decay channels. In 
all channels the numbers of events found are compatible with background 
estimates and branching fraction upper limits are set for 28 different decay 
modes. These limits are either more stringent than those set previously or 
represent the first attempt to find these decays. 

PACS numbers: 13.35.Dx, 14.60.Fg 
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In the Standard Model of electroweak interactions the difference between the number of leptons 
and the number of antileptons is conserved for each generation separately. However, there is 
no fundamental motivation for this lepton flavor conservation in this theory because there is no 
symmetry associated with lepton family number. Many extensions of the Standard Model predict 
flavor violation in lepton decays. Among them are models that involve heavy neutral leptons 
left-right symmetries [p[- p^] , supersymmetry ]ll-14] or superstrings [|l^-p^. The expected decay 



branching fractions in these models depend on the unknown masses of proposed new particles and 
on the new coupling constants. The most optimistic branching fraction predictions are at the level 
of about 10~^. Constraints on lepton flavor violation come from studies of rare and forbidden K, 
TT, and /i decays, e-/i conversions, neutrinoless double beta decays, neutrino oscillations, Z lfl2 
decays, and other rare processes. In particular, there are strict limits on muon neutrinoless decays: 
B{iJ, 67) < 4.9 X 10~^^ and B{fi eee) < 2.4 x 10~^^ at 90% confidence level [|l8|. However, 
lepton number violation rates may exhibit a strong dependence on mass and on generation number 
of the decaying particle, thus enhancing tau lepton decay rates. Also, the larger mass of the tau 
allows for new decay types which are kinematically forbidden for the muon. 

The CLEO collaboration has already performed comprehensive searches for neutrinoless tau 



decays in various channels [19-21|. The analysis presented in this paper updates the results of 
Ref. with a more than twofold increase in the dataset size. The search also includes six 
additional channels. A detailed description of this analysis can be found in Ref. ||2^. We search 
for tau decays into three charged particles: 

(hhk)'^, / = e or 
r± ^ {lhih2)^, /i = 7r± or . 

All possible combinations of final state particles and charge assignments are considered, except 
for those that do not conserve electric charge. Different assignments result in either lepton flavor 
violating decays, as in r~ — >• jj,~e^e~ , or both lepton flavor and lepton number violating decays, 
as in T~ — > e"'"7r~7r~. We also search for r decays into one charged lepton and one neutral meson 
which can subsequently decay into two charged hadrons thus resulting in three charged particles 
in the final state: 

l^M, M = (j), K*^, or K*^. 

The channels with two charged kaons, possibly coming from the decay of (j) meson, have been 
searched for the first time. 

The data used in this analysis were collected with the CLEO II detector [^] at the Cornell 
Electron Storage Ring (CESR). We use information from a 67-layer tracking system which also 
provides specific ionization measurements (dE/dx), time-of- flight scintillation counters and a 7800- 
crystal Csl calorimeter. These elements are inside a 1.5 T superconducting solenoidal magnet 
whose iron yoke also serves as a hadron absorber for a muon identification system. Tau leptons 
were produced in pairs in e~''e~ collisions at a center-of-mass energy of about 10.6 GeV. The data 
correspond to an integrated luminosity of 4.79 fb~^, and the number of produced tau pairs is 
4.37- 10^. 

We follow the search method described in Ref. Q|. Signal candidate tau decays are required 
to produce three well-reconstructed tracks in the detector (3-prong decay). The other tau in the 
event must decay into a 1-prong mode, and the total visible charge must be zero. Not more than 
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one photon candidate or background shower in the Csl calorimeter is allowed on the 3-prong side 
of the event. 

At least one charged particle on the 3-prong side is required to satisfy electron or muon iden- 
tification criteria. These criteria are more strict in the — s- {lh\h2)^ and the l^M decay 
channels than in the — > (/i/2^3)^ channels because of large background from tau decays into 
three pions and a neutrino, in which one of the pions is misidentified as an electron or a muon. 
Electrons are identified by requiring that the ratio of the energy deposited by the particle in the Csl 
calorimeter to the momentum measured in the drift chamber is close to unity. Muon candidates 
are required to have a well-reconstructed track in the muon system. Charged mesons (vr or K) 
are not positively identified, and we try all possible meson type assignments to tracks. Thus, a 
single event can be a candidate for more than one final state. In the channels involving neutral 
mesons we require the two-hadron invariant mass to be consistent with that of the corresponding 
meson: M^+^- < 1.2 GeV/c^ for , 0.7 GeV/c < M^±k^ < 1.1 GeV/c^ for K*'^ and K*^, 
0.99 GeV/c < M^±^t < 1-05 GeV/c for 0, where the mass interval is based on the resonance 
width and the detector resolution. 

The main backgrounds remaining after application of particle identification requirements are 
photon conversions in radiative Bhabha and muon pair events, two-photon processes, low multiplic- 
ity hadronic events, and r — >■ Shvr decays in which at least one hadron is misidentified as a lepton. 
Photon conversions in the detector material produce e'^e~ pairs with small invariant masses. To 
suppress conversions, we consider each pair of oppositely charged particles not identified as muons 
under the assumption that both particles are electrons. Events are rejected if the invariant mass 
is less than 0.15 GeV/c^ for any such pair. Two-photon processes have low values of the total 
transverse momentum with respect to the beam direction. In contrast, the signal events have at 
least one undetected neutrino on the 1-prong side which leads to transverse momentum imbalance. 
We reduce two-photon background contribution by requiring transverse momentum in excess of 
0.2 GeV/c. Neutrino presence in the event is further exploited by requiring at least 3° acollinearity 
between the direction of the sum of charged particles' momenta on the 3-prong side of the event 
and the direction of the 1-prong momentum. For neutrinoless decays the sum of the four-momenta 
of the particles on the 3-prong side define the tau direction and energy. Neglecting radiative effects, 
the other tau in the event has an opposite momentum vector. We determine the momentum of 
the 1-prong charged particle in the rest system of a parent tau with boost parameters obtained 
by summing the four-momenta of the 3-prong side particles. Momentum values larger than half of 
tau mass are kinematically forbidden for tau decay products in the rest frame of decaying particle. 
However, presence of a neutrino on the 3-prong side of the event may result in incorrect determi- 
nation of boost parameters and higher momentum. We require that the 1-prong momentum in the 
parent tau rest frame is less than 1 GeV/c, thus reducing background from standard tau decay 
modes. 

The efficiencies of the selection criteria were estimated using 16 000 Monte Carlo events for 
each decay channel. Phase space distributions were used to generate neutrinoless tau decays in 
all the channels. The KORALB/TAUOLA program package [^] was used to simulate the tau- 
pair production and the decay of the 1-prong tau. Subsequent meson decays and decays of the 
1-prong tau were generated according to the known branching fractions |18|. Detector signals were 
simulated with the GEANT-based CLEO II simulation program |25|. 

For neutrinoless tau decays the total energy measured on the 3-prong side, E3, must be equal to 
the beam energy, -Bbeam; and the invariant mass of the three charged particles, M3, must be equal 
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to the tau mass. For all channels we select rectangular signal regions in the ii^3 — E'beam and M3 vari- 
ables taking into account detector resolution, signal efficiencies, and background levels. The signal 
region optimization algorithm (minimization of average expected upper limits) is described in detail 



in Ref . ||2^ . We assign the channels studied to three different groups according to their background 
density. For the channels with low background (r~ — > e~e^e~, e~(/>, e^^^/i^, and ^^e^e^, where 
charge conjugated modes are always implied) we define the signal region as 

- 0.39 GeV < ^3 - Ebeam < 0.08 GeV, 
1.70 GeV/c^ < M3 < 1.81 GeV/c^ 

For the medium background channels (r~ — > e^/U+^^, fx^fi^fi^, e'^ir^K^, /x^e^e^, e+vr^vr^, 
e~^K~K~, and //"</>) we require 

- 0.17 GeV < ^3 - Ebeam < 0.09 GeV, 

1.74 GeV/c^ < M3 < 1.80 GeV/c^ 

and for the rest of the channels (high background group) we require 

- 0.09 GeV < ^3 - Ebeam < 0.06 GeV, 

1.75 GeV/c^ < M3 < 1.80 GeV/c^ 

The 3-prong invariant mass distributions of events satisfying all background suppression criteria 
and lying within the E^ — E^eam limits defined above are shown in Figs. |l| and ^, together with 
the expected signal shapes generated by the Monte Carlo simulation. There are 14 events in the 
data which satisfy all the selection criteria, including the 3-prong invariant mass requirement, in at 
least one channel. 7 of these events satisfy the selection criteria in two different channels (notably, 
most candidates for —)■ l^M decays also qualify for corresponding non-resonant decays), and 
1 event satisfies the selection criteria in three different channels. In each channel the number of 
data events inside the signal region is consistent with the estimated background level. The largest 
deviation is observed in the t~ — > e~'TT'^K~ channel which has three events while the expected 
background is 0.42 events. The probability of such a deviation or larger is about 1%, if calculated 
according to Poisson statistics. However, with 28 channels investigated, such fluctuations can be 
expected in one or two of them. In addition, Poisson statistics may fail to provide an accurate 
consistency check because, due to the small size of the event sample remaining after background 
suppression, we use the same sideband data for both signal region optimization and background 
estimation. 

In each channel we calculate the branching fraction upper limit at the 90% confidence level 



according to the convention adopted by the Particle Data Group [|18[, and we do not attempt 
to subtract the background. Systematic errors in this analysis arise from uncertainties in our 
knowledge of the luminosity, track reconstruction efficiency, lepton identification efficiency, and 3- 
prong energy and invariant mass resolutions. Combined together, they are conservatively estimated 
to increase branching fraction upper limits by 10%. We do not assign any systematic error due to 
model dependence. However, we emphasize that our limits depend on the assumed angular and 
momentum distributions of the decay particles. 

The final results are summarized in Table ||, together with the detection efficiencies obtained for 
each mode from Monte Carlo simulations and with the numbers of events observed in the data. The 



limits obtained in this analysis are more stringent than those obtained previously |18|. In addition. 
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the limits on B{t~ fj,~^e~e~) and B{t~ — s- e^/x~;U~) are the most stringent hmits to date on 
lepton number violation in r decays. In SUSY with broken R-parity [13,lJ] and in the model with 
radiatively generated lepton masses from Ref. [|[ the obtained results provide constraints on model 
parameters. In models with heavy neutral leptons ||5|-0 the experimental limits are close to the 
allowed range of neutrinoless r decay rates. 

We gratefully acknowledge the effort of the CESR staff in providing us with excellent luminosity 
and running conditions. J.P.A., J.R.P., and I.P.J.S. thank the NYI program of the NSF, M.S. 
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TABLES 

TABLE L Detection efficiencies, event statistics, expected backgrounds, and upper limits for 
branching fractions at 90% confidence level. 



Decay 


Detection 


Events 


Expected 


Upper 


channel 


efficiency, % 


observed 


bg events 


limits, 10"^ 



t" — ^ e'e'^e" 17.0 

T~ — /i~e'*"e~ 16.8 

T~ — fi'^e~e~ 19.5 

T" — >■ e~ ji^ ji" 16.5 

T~ e+n'ii- 19.9 

T~ ix^ fi" 15.0 

T~ — > e~7r+7r~ 13.2 

r" e-Tr-K+ 13.0 

r" e-vr+K" 13.1 

r- ^ e-K+K- 11.2 

r~ — ^ e"'"7r~7r~ 15.3 

r" ^ e+7r~if~ 14.0 

T" ^ e+K-R- 13.0 

T~ — > /i^7r+7r~ 8.2 

r" — >■ ii~'K~K~^ 6.7 

r~ — > ii~tt'^K'' 6.5 

r- ^ fi-K+K- 4.5 

r" — >■ //"'"7r~7r~ 8.6 

T" -> i^+TT-R- 7.0 

T- n+K-R- 4.8 

r- ^ e-p° 14.4 

r- ^ e-if*° 9.5 

T- e-K*° 9.0 

r" e-4> 7.2 

T" ^ 10.6 

r- ^ 6.5 

T- fi-K*^ 6.5 
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FIG. 1. Distributions of the invariant mass of the 3-prong side particles, M3, for the data 
(shaded histogram) and signal Monte Carlo events (solid line). The expected signal shapes are 
shown with arbitrary normalization. The dotted lines indicate the boundaries of the signal regions 
used. See also Fig. 0. 
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FIG. 2. Distributions of the invariant mass of the 3-prong side particles, M3, for the data 
(shaded histogram) and signal Monte Carlo events (solid line). The expected signal shapes are 
shown with arbitrary normalization. The dotted lines indicate the boundaries of the signal regions 
used. See also Fig. H. 
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